What is claimed is: 

L A method to calcxilate an element R(x,y) of a viewpoint-independent spatial covariance 
matrix of a given object in a database for infinitely dense sampling of illumination 
conditions, the method comprising: 

calculating E{ux,Uy,c\ an integral over all possible light directions, weighted by their 
respective intensities, according to the equation: 
E{Ux,Uy,c)--^^^^^ L(n)D(n,p,q) 

where ne is a particular direction on the unit sphere, S^, where L is the light 
intensity and n is a normal vector on the unit sphere S^, where Wx and % are the unit 
vectors of the special coordinate system defined by p and g, where p and q are vectors 
in which the x-axis is the bisector of the angle, 29, between them, where p = (c,+^,0) 
and ^ = (c,-5,0), where c = cosO, s = sine, and (x,y) is the image point; 
solving for the viewpoint-independent spatial covariance matrix R(x,y) according to 
the equation: 

R(x,y) =a(x)cL(y)Eiu,,u^,c) 

where a(x) is the intrinsic reflectance at the image point x and a(y) is the intrinsic 
reflectance at the image point y; and 

tabulating and storing the result of said viewpoint-independent spatial covariance 
matrix R(x,y). 

2. A method to calculate an element R(x,y) of a viewpoint-independent spatial covariance 
matrix of a given object where there is no preferred direction in the illumination, the 
method comprising: 
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calculating E(c(p(x),q(y))), according to the equation: 

E(c)=\ , , c'nl-(l-c')nl 
where ne is a particular direction on the unit sphere, where C(n,c) is the joint- 
visibility condition, where n is the given direction, where and 9 are vectors in which 
the X-axis is the bisector of the angle, 26, between them, where;? = (c,+5,0) and ? = 
(c,-5,0), where c = cose, s = sinG, and (x,y) is the image point; 
solving for the viewpoint-independent spatial covariance matrix R(x,y) according to 
the equation: 

Rix,y) ==aixMy)E(c{p(x),q{y))) 
where a(x) is the intrinsic reflectance at the image point x and a(y) is the intrinsic 
reflectance at the image point y; and 

tabulating and storing the result of said viewpoint-independent spatial covariance 

matrix R(x,y). 
The method of claim 2, comprising: 

using tiie Monte Carlo procedure to evaluate the integral for E(c) in claim 2. 
A method for finding a set of Q pairs of reference values for the albedo and normals, 
^g>^)}^Q> such that the perturbations are smallest for a given value of Q, the method 

comprising: 

using vector quantization algorithms to cluster a set of vectors 
{(a(x) p{x))}^y together in Q clusters; 

finding the centroids |^^,^)}^g of said clusters such that the average distance from 
the vectors to the nearest respective cluster-centi-oid, q(x)sqx, is minimal, where 


22 


is a reference albedo to an albedo a(x), q is a. reference normal close to a vector 

normal to the surface, p(x)5 and x is a point on the surface of an object; and 
storing the results. 

5. The method of claim 4, comprising: 

using a Linde-Buzo-Gray algorithm as said vector quantization algorithm. 

6. The method of claim 4, comprising: 

using a Deterministic Annealing algorithm as said vector quantization algorithm. 

7. A method to generate a low-dimensional basis of the viewpoint-dependent illumination 
subspace from the pre-computed viewpoint-independent hierarchy of eigen-surfaces, the 
method comprising: 

generating and diagonalizing said object's vector-quantized viewpoint-independent 
CO variance matrix Rq ; 

determining the eigenbasis hierarchy defined on the surface of the object from the 
results of Rq , using the equation: 


where Q is the desired complexity, where a/ is the non-increasing eigenspectrum of 
the spatial and the temporal covariance matrices, where and A|/^(v) are the 

respective orthonormal eigenvectors of said spatial and temporal covariance matrices, 
and (w,v) is a point on the surface of the object; 

choosing a cutoff, N, such that the average residual signal power, trRj^, is between the 
values of 0.1 - 10; 

keeping only the first AT eigensurfaces and storing the results for subsequent use; 
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warping said stored N eigensurfaces to a basis of the viewpoint-dependent 
illumination subspace at the viewpoint-dependent stage using the equation: 

when a query at a particular viewpoint needs to be matched to the objects in said 
database; and 
storing the results. 

8. The method of claim 7, further comprising the step of finding M, the final dimensionality 
of the viewpoint-dependent eigen-subspace, the method comprising: 

warping a viewpoint dependent, non-eigen-subspace of dimensionality N firom a 
viewpoint independent eigen-subspace of dimensionality N; and 
finding the leading M-dimensional viewpoint dependent eigen-subspace of the N- 
dimensional viewpoint dependent non-eigen-subspace resulting fi-om said warp, 
according to the equation: 

where 

_ N 

where Gp and U^^ are determined by the eigenvalue decomposition of an NxN 
matrix where 

X 

9. The method of claim 8, comprising: 
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the final dimensionality of the viewpoint dependent subspace, M, having a value up 
to 20. 

10. The method of claim 9, comprising: 

the final dimensionality of the viewpoint dependent subspace, having a value 
between 4 and 9, inclusive. 

1 1 . The method of claim 8, comprising: 

having the value of N not less than 2 times the value of M, and not more than 8 times 
the value ofM. 
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